<!DOCTYPE html><html><head><meta charset="UTF-8"><title>Next Decade in Languages: User Code on the GPU Comments</title><style>
    .comment {
      overflow: hidden;
      padding: 18px 0 7px 0;
      clear: both;
    }

    .comment + .comment {
      border-top: 1px solid #e8e8e8;
    }

    .comment > .json {
      display: none;
    }

    .comment-box {
      background-color: #fffbe1;
      overflow: hidden;
      padding: 6px 12px;
      margin-bottom: 8px;
    }

    .reply-box {
      background-color: #eff2f9;
      padding: 6px 12px 6px 6px;
      overflow: hidden;
      margin-bottom: 8px;
    }

    .user-name {
      font-weight: bold;
      padding-right: 10px;
    }

    .comment > .author-picture {
      float: left;
      padding: 0 20px;
    }

    .reply-box > .author-picture {
      float: left;
      padding: 0 6px;
    }

    .comment-deleted {
      color: red;
      padding-right: 10px;
    }

    .author-picture + div, .user-name, .user-name + .comment-deleted, .user-name + .comment-action {
      float: left;
    }

    .created-date {
      color: #999;
    }

    .comment-box .comment-content {
      clear: both;
    }

    .comment-box > .created-date {
      float: right;
    }

    .reply-box .created-date {
      clear: both;
    }

    .comment-context-intro {
      color: #999;
      clear: both;
    }

    .comment-context-value {
      border-left: 1px solid #ccc;
      font-style: italic;
      padding: 3px 10px 3px 10px;
    }

    .comment-action {
      font-style: italic;
    }

    .comment-status {
      font-style: italic;
      color: green;
      float: left;
      font-weight: bold;
      padding-right: 10px;
    }
  </style></head><body><section class="header"><h1>Next Decade in Languages: User Code on the GPU - Drive File Comments</h1></section><section><div id="AAAAYzQ67JQ" class="comment"><div class="json">null</div><div class="author-picture"><img src="https://lh3.googleusercontent.com/a-/AOh14GjoOXwuji1Q0p6FX0IRu-PBtgN-CxWdF8wvbNemn1A=s50-c-k-no" width="48" height="48" alt="Author profile image"></div><div class="comment-data"><div class="comment-box"><div class="user-name">Evan Ovadia</div><div class="comment-status"></div><div class="created-date">May 8, 2022, 5:19 AM</div><div class="comment-context"><div class="comment-context-intro">Selected text:</div><div class="comment-context-value">scan, filter</div></div><div class="comment-content">must doublecheck</div></div><div class="reply-list"></div></div></div><div id="AAAAYxIzqWs" class="comment"><div class="json">null</div><div class="author-picture"><img src="https://lh3.googleusercontent.com/a-/AOh14GjoOXwuji1Q0p6FX0IRu-PBtgN-CxWdF8wvbNemn1A=s50-c-k-no" width="48" height="48" alt="Author profile image"></div><div class="comment-data"><div class="comment-box"><div class="user-name">Evan Ovadia</div><div class="comment-status"></div><div class="created-date">May 8, 2022, 1:41 AM</div><div class="comment-context"><div class="comment-context-intro">Selected text:</div><div class="comment-context-value">Cores 1-5 will run B. Cores 6-10 *will wait for them to finish.*</div></div><div class="comment-content">Could use a little diagram here</div></div><div class="reply-list"></div></div></div><div id="AAAAYmTDg0I" class="comment"><div class="json">null</div><div class="author-picture"><img src="https://lh3.googleusercontent.com/a/AATXAJyZtZ_eF5hrxgc9GukoTy42QbSaKK9FycPlptw4ng=s50-c-k-no" width="48" height="48" alt="Author profile image"></div><div class="comment-data"><div class="comment-box"><div class="user-name">Taher</div><div class="comment-status">Resolved</div><div class="created-date">Apr 28, 2022, 4:41 AM(edited: May 8, 2022, 5:50 AM)</div><div class="comment-context"><div class="comment-context-intro">Selected text:</div><div class="comment-context-value">warps</div></div><div class="comment-content">&quot;In keeping with the 3D graphics tradition of clear and consistent naming, the SIMD concept is called SIMD groups on Metal, warps on Nvidia, wavefronts on AMD, and subgroups on Vulkan&quot;</div></div><div class="reply-list"><div id="AAAAYzQ67Jk" class="reply-box"><div class="author-picture"><img src="https://lh3.googleusercontent.com/a-/AOh14GjoOXwuji1Q0p6FX0IRu-PBtgN-CxWdF8wvbNemn1A=s50-c-k-no" width="24" height="24" alt="Author profile image"></div><div class="reply-data"><div class="user-name">Evan Ovadia</div><div class="comment-content">great quote! used it above</div><div class="created-date">May 8, 2022, 5:50 AM</div></div></div><div id="AAAAYzQ67Jo" class="reply-box"><div class="author-picture"><img src="https://lh3.googleusercontent.com/a-/AOh14GjoOXwuji1Q0p6FX0IRu-PBtgN-CxWdF8wvbNemn1A=s50-c-k-no" width="24" height="24" alt="Author profile image"></div><div class="reply-data"><div class="user-name">Evan Ovadia</div><div class="comment-action">Marked as resolved</div><div class="comment-content"></div><div class="created-date">May 8, 2022, 5:50 AM</div></div></div></div></div></div><div id="AAAAYmTDgzM" class="comment"><div class="json">null</div><div class="author-picture"><img src="https://lh3.googleusercontent.com/a/AATXAJyZtZ_eF5hrxgc9GukoTy42QbSaKK9FycPlptw4ng=s50-c-k-no" width="48" height="48" alt="Author profile image"></div><div class="comment-data"><div class="comment-box"><div class="user-name">Taher</div><div class="comment-status"></div><div class="created-date">Apr 28, 2022, 4:24 AM</div><div class="comment-context"><div class="comment-context-intro">Selected text:</div><div class="comment-context-value">warps</div></div><div class="comment-content">this is specific to nvidia. <br><br>&quot;SIMD groups on Metal, warps on Nvidia, wavefronts on AMD, and subgroups on Vulkan&quot;</div></div><div class="reply-list"></div></div></div><div id="AAAAYrd8TVY" class="comment"><div class="json">null</div><div class="author-picture"><img src="https://lh3.googleusercontent.com/a-/AOh14GjoOXwuji1Q0p6FX0IRu-PBtgN-CxWdF8wvbNemn1A=s50-c-k-no" width="48" height="48" alt="Author profile image"></div><div class="comment-data"><div class="comment-box"><div class="user-name">Evan Ovadia</div><div class="comment-status"></div><div class="created-date">Apr 25, 2022, 8:33 PM(edited: Apr 28, 2022, 4:38 AM)</div><div class="comment-context"><div class="comment-context-intro">Selected text:</div><div class="comment-context-value">[surprising use case]</div></div><div class="comment-content">must find a good use case that&#39;s <b>not</b> graphics related. AI maybe? number crunching? preferably something that average programmers can relate to, that will surprise them and seem obvious in hindsight.</div></div><div class="reply-list"><div id="AAAAYmTDg0E" class="reply-box"><div class="author-picture"><img src="https://lh3.googleusercontent.com/a/AATXAJyZtZ_eF5hrxgc9GukoTy42QbSaKK9FycPlptw4ng=s50-c-k-no" width="24" height="24" alt="Author profile image"></div><div class="reply-data"><div class="user-name">Taher</div><div class="comment-content">CPU parallelism comes from &quot;SIMD&quot; single instruction and multiple data. If you were to go in details these would be AVX/AVX2 registers for Intel x86 chips also called &quot;Intel intrinsics&quot; not sure what&#39;s the equivalent is on arm64, Neon?<br><br>However, on GPUs it&#39;s &quot;SIMT&quot; Single instruction. A few use cases can be (thinking out loud here):<br><br>1. bitcoin mining<br>2. high-end image processing? gfx apps like Photoshop utilize some of of the processing on the GPU, Open cv stuff?<br>3. gaming? high-end physics engine, collision detection?<br>4. medical? xrays? mri?</div><div class="created-date">Apr 28, 2022, 4:38 AM</div></div></div></div></div></div><div id="AAAAYrd8TVU" class="comment"><div class="json">null</div><div class="author-picture"><img src="https://lh3.googleusercontent.com/a-/AOh14GjoOXwuji1Q0p6FX0IRu-PBtgN-CxWdF8wvbNemn1A=s50-c-k-no" width="48" height="48" alt="Author profile image"></div><div class="comment-data"><div class="comment-box"><div class="user-name">Evan Ovadia</div><div class="comment-status"></div><div class="created-date">Apr 25, 2022, 8:32 PM</div><div class="comment-context"><div class="comment-context-intro">Selected text:</div><div class="comment-context-value">while the rest of us weren&amp;#39;t looking</div></div><div class="comment-content">must think about how this reads to someone who <b>has</b> been paying attention and already knows all this.</div></div><div class="reply-list"></div></div></div><div id="AAAAYrd8TVQ" class="comment"><div class="json">null</div><div class="author-picture"><img src="https://lh3.googleusercontent.com/a-/AOh14GjoOXwuji1Q0p6FX0IRu-PBtgN-CxWdF8wvbNemn1A=s50-c-k-no" width="48" height="48" alt="Author profile image"></div><div class="comment-data"><div class="comment-box"><div class="user-name">Evan Ovadia</div><div class="comment-status"></div><div class="created-date">Apr 25, 2022, 8:31 PM</div><div class="comment-context"><div class="comment-context-intro">Selected text:</div><div class="comment-context-value">then CUDA came out, allowing us to put arbitrary C code on the GPU.</div></div><div class="comment-content">i just made this up. what was the actual first user code on the GPU?</div></div><div class="reply-list"></div></div></div><div id="AAAAYrd8TVM" class="comment"><div class="json">null</div><div class="author-picture"><img src="https://lh3.googleusercontent.com/a-/AOh14GjoOXwuji1Q0p6FX0IRu-PBtgN-CxWdF8wvbNemn1A=s50-c-k-no" width="48" height="48" alt="Author profile image"></div><div class="comment-data"><div class="comment-box"><div class="user-name">Evan Ovadia</div><div class="comment-status">Resolved</div><div class="created-date">Apr 25, 2022, 8:31 PM(edited: Apr 27, 2022, 1:40 AM)</div><div class="comment-context"><div class="comment-context-intro">Selected text:</div><div class="comment-context-value">Next Decade in Languages</div></div><div class="comment-content">there&#39;s likely a better name for the series. this seems a bit bland. &quot;Surprising Advances in Languages&quot; is a little bit better, but not quite what im after. hmm.</div></div><div class="reply-list"><div id="AAAAYLRQ8p0" class="reply-box"><div class="author-picture"><img src="https://lh3.googleusercontent.com/a-/AOh14GjoOXwuji1Q0p6FX0IRu-PBtgN-CxWdF8wvbNemn1A=s50-c-k-no" width="24" height="24" alt="Author profile image"></div><div class="reply-data"><div class="user-name">Evan Ovadia</div><div class="comment-action">Marked as resolved</div><div class="comment-content"></div><div class="created-date">Apr 27, 2022, 1:40 AM</div></div></div></div></div></div></section></body></html>